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Abstract 

Many communication systems involve high bandwidth, while sparse, radio frequency 
(RF) signals. Working with high frequency signals requires appropriate system-level 
components such as high-speed analog-to-digital converters (ADC). In particular, an 
analog signal should be sampled at rates that meet the Nyquist requirements to avoid 
aliasing. However, implementing high-speed ADC devices can be a limiting factor as 
well as expensive. To mitigate the caveats with high-speed ADC, the solution space 
can be explored in several dimensions such as utilizing the compressive sensing (CS) 
framework in order to reduce the sampling rate to the order of information rate of 
the signal rather than a rate dictated by the Nyquist. In this note, we review the 
compressive sensing structure and its extensions for continuous-time signals, which is 
ultimately used to reduce the sampling rate of high-speed ADC devices. Moreover, 
we consider the application of the compressive sensing framework in wireless sensor 
networks to save power by reducing the transmission rate of sensor nodes. We propose 
an alternative solution for the CS minimization problem that can be solved using 
gradient descent methods. The modified minimization problem is potentially faster 
and simpler to implement at the hardware level. 


1 Introduction 

Considerable advances in Radio Frequency (RF) communications and related hardware de¬ 
velopment make it an appropriate tool for a variety of applications. In addition to well- 
known wireless products, RF technology has other applications creating great space for 
growth. In most of these systems and in order to use off-the-shelf digital signal processing 
(DSP) blocks, the analog signal first needs to be digitized. However, in order to be able 
to recover the original signal without aliasing, the sampling rate should meet the Nyquist 
sampling requirements. In the case of high frequency signals, design and implementation of 
high-speed analog-to-digital converters (ADC) is a challenge as the Nyquist rate can easily 
exceed the current capabilities of ADC devices. For example, some radar applications would 
be best served by an ADC sampling rate of over 5G samples per second and a resolution of 
over 20 bits per sample, a combination that greatly exceeds current capabilities [l]. Besides, 
high-speed ADC devices become very expensive. Within this context, it is necessary to 
develop algorithms that can relax the requirements for high-speed ADC devices. 
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In recent years, compressive sensing (CS) framework has been introduced that enables 
sparse signals sensing at a sub-Nyquist rate. According to the CS theory, a sparse signal 
can be represented by a number of random projections and recovered from these projections 
with a high probability. The CS framework introduces a novel framework for analog-to- 
information conversion when the target signal is sparse with high frequency components. 
Therefore, ADC devices can be designed to work based on the Nyquist requirements for the 
compressed version of signal. 

The rest of this report is organized as follows. In Section [2] we provide a brief back¬ 
ground on discrete-time compressive sensing, followed by its extension to continuous-time 
and compressive sensing with parallel branches. Section [3] focuses on reducing transmission 
rates in wireless sensor networks using compressive sensing. Our tweak in the compressive 
sensing minimization problem is presented in Section [4j We conclude with overall thoughts 
in Section [5] 

2 Compressive Sensing 

In this section, we review the compressive sensing framework for discrete and continuous 
time signals, and further explain the application of compressive sensing in ADC sampling 
rate reduction. 

2.1 Discrete-time signal 

According to the compressive sensing theory, a discrete-time signal can be represented by 
a number of projections on a random basis. In particular, given a AT-Sparse signal vector 
/jvxi and the basis ^nxm, we have: 

/ = *«; (i) 

in which a is the coefficient vector for the signal of interest / under the basis T. Here, by 
If-Sparse, we mean that / has K nonzero elements only. One key point is that it can be 
proved that sparseness is equivalent to compressibility and vice versa. At the receiver side, 
it is critical to be able to reconstruct the original signal from the compressed version. In 
this case, assume that an Lx N measurement matrix <f> and measurement outputs yLxi are 
given such that: 

V = $/■ (2) 

In this equation, vector / is of interest and needs to be recovered from the matrix $ and 
measurement results y with the constraint L < N. Because Eq. 0 represents an undeter¬ 
mined system of equations, there are infinitely possible solutions for signal. However, if the 
signal / is known to be sparse, then the most sparse solution would be acceptable. From 
0 and 0, we have: 

V = *f = (3) 

where vector a should be determined. To apply the constraint of sparsity on the vector a, 
we have: 

a* = argmin |a|i, 

(4) 

subject to y = •hTa. 
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In order to solve this minimization problem, there exist several algorithms such as Orthogo¬ 
nal Matching Pursuit (OMP) [2]. Therefore, signal / would be reconstructed as f* = H/a*. 

Before proceeding, we would like to highlight a fact regarding the relationship between $ 
and 'h. As discussed earlier, CS relies on the sparseness of the signals. CS also depends on 
the incoherence matrices $ and *P. Fortunately, random sensing matrices $ are incoherence 
with any basis and this relaxes knowing basis 'P a priori. Moreover, there are several choices 
for the distribution of random projections such as Gaussian and Bernoulli. 

2.2 Continuous-time signal 

As described in the previous section, compressive sensing framework was first proposed for 
discrete-time signals. However, with slight modifications it can be applied to continuous¬ 
time signals as well, where we are interested in using compresisve sensing to avoid high-speed 
ADC devices. The authors in [3] have proposed a structure shown in Fig. [T] 
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Figure 1: CS diagram for analog signals [3] 


In this structure, the analog signal x(t ) is first demodulated by a pseudo-random sequence 
p(t) in order to spread the frequency contents of the signal so that it is not destroyed by the 
second stage of the system. In the second step, demodulated signal is filtered by a low-pass 
filter h(t), and finally the signal is sampled by a low-rate ADC. Assuming that the signal 
x{t) is sparse , we can decompose it into N basis signals as follows: 


N 

*(t)=5>lk(t)- (5) 

i= 1 

With this representation of signal x(t) and the block diagram of Fig JT] output y(t) becomes: 


/ oo 

x(r)p{T)h(t - t) dr; 

-OO 


and after sampling we have: 

y[m\ = y(t) 

By rewriting y[m\ according to the basis expansion of signal x(t) we have: 

N 


/ oo 

ij)%(j)p(j)h(rnM - r) dr; 

-OO 


( 6 ) 

(7) 

( 8 ) 
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and defining: 


results that: 


/ OO 

4’i( T ) p( t ) h(mM - t) dr 

-OO 


N 

y[m] = ^2 OHV m ,i ■ 

i =1 


( 9 ) 

( 10 ) 


Or in a matrix format: Y = Va. 

Note that the matrix V here serves the same purpose of the combination of < f > d' in Eq|3] 
Therefore, analog signal reconstruction leads to finding an optimal solution for a such that: 


a* = argmin |a|i 
subject to Y = Va. 


The reconstructed signal is then: 

N 

x *(t ) = J2°‘i^ t ) 

i= 1 


(ii) 


( 12 ) 


where a* is the solution for the optimization problem. Therefore, the compressive sensing 
structure allows the sparse signal x(t) (i.e., output of the low-pass filter) to be sampled at 
a sub-Nyquist rate. 


2.3 Parallel structure 

In the previous section, we studied a serial structure to apply compressive sensing on 
continuous-time signals. Although it is a promising approach to reduce the sampling rate 
of high-rate ADC devices, to achieve a high-quality signal reconstruction the order of filter 
is typically higher than 10, which may not be desirable to design and implement complex 
high-order filers. To this end, a parallel segmented compressive sensing (PSCS) has been 
proposed in [4]. In this scheme, the continuous signal is first segmented into overlapping 
partitions. Next, compressive sensing is applied to each segment independently, and the 
outputs of each segment are combined together in order to reconstruct the signal efficiently. 
PSCS can be used in applications such as cognitive radio wherein the spectrum sensing is 
crucial for successful operations. 

Here, we review the concepts of PSCS and the details follows from the serial structure. 
First, analog signal x(t) is time windowed into M pieces, i.e.,: 

x m (t) = x(t)w m (t) for to = 1, ...,M; (13) 

in which x m (t) has a duration of T c and w m (t) is the window function as shown in Fig. [2] 
Parallel segmented compressive sensing consists of a number of parallel fingers and each 
window of signal is applied to these fingers to produce output samples. PSCS structure is 
shown in Fig. [3l wherein y m N+n represents measuring the m th segment on the n th branch. 
It should be noted that integrator blocks have the same functionality as the low-pass filter in 
the serial structure. The problem caused by this method is that each segment has incomplete 
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Figure 2: Time-windowed analog signal [?] 
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Figure 3: Parallel structure of CS [4] 


information about the signal, and thus all elements of matrix Ymxn should be processed 
jointly. In other words, we have: 


Y=[Y 0 t ,Y? 




(14) 


in which 


Ym — [VmN i ymN-\-h •••5 VmN+N— l] 


(15) 


As the last step in CS, we should have a reconstruction matrix. Similar to matrix V in 
the serial structure, here we also have a matrix which elements are the result of inner 
product of sensing random basis p(t) and expansion basis T ( t ) with slightly adjustment for 
segmentation. 


3 Transmission rate reduction 

So far, we studied the discrete and continuous-time formulations of compressive sensing to 
reduce the sampling rate in ADC devices. Besides the ADC application, compressive sens¬ 
ing can serve other goals such as reducing the transmission rate in battery-powered wire¬ 
less sensor networks. Wireless sensor networks boast numerous applications ranging from 
home appliance control to environmental monitoring and smart healthcare. For instance, 
they have demonstrated benefits for intelligent transport systems: monitoring aircraft sys¬ 
tems and parameters [5], monitoring wheel bearings on trains [B], and connecting sensors, 
switches, and actuators inside cars DO 0- In these applications, energy consumption by 
sensor nodes is a critical issue as they are typically powered by battery. In most of wireless 
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Figure 4: Transmission rate reduction with compressive sensing [101 


sensor platforms, radio components of nodes consume most of energy. Previous experiments 
and simulations in [9] show that energy consumption by the radio is dominant in wireless 
sensor motes. For instance, the radio of TelosB motes (CC2420) draws 11 mA current to 
transmit at a power of -10 dBm and 17.4 mA to transmit at a power of 0 dBm. However, 
it should be noted that other components, such as the processor, consume energy, and that 
their energy consumption depends on the instructions run by the mote. 

Motivated by the power consumption issue, we investigate an application of compressive 
sensing theory in wireless sensor networks to reduce the rate of transmissions and thus 
the amount of power consumption. As discussed earlier, compressive sensing provides a 
structure to acquire data at a rate proportional to the information rate rather than the rate 
required by the Nyquist rate. Transmitting data (similar to sampling in the context of ADC 
devices) with a lower rate can be highly beneficial for battery-powered sensor nodes such as 
biomedical sensors. 

Within this context, Fig. [I] shows a schematic of sensors with compressive sensing. In 
this figure, the transmission rate decreases proportional to the rate of compression, and 
thus it can significantly reduce the actual transmission rate (i.e., without compression) and 
the power consumption. It is worthy to note that the CS mechanism of compression and 
reconstruction follows the same procedure discussed before, and that in most of wireless 
sensor networks, the sampling frequency is rarely a limiting factor, which implies that CS 
can be applied to the digitized outputs of ADC rather than prior to digitization. 


4 p-norm minimization 


In this section, we propose an enhancement to the compressive sensing framework, with 
the goal of faster and simpler convergence in the CS reconstruction stage. In the previous 
section, we discussed about the compressive sensing and that to reconstruct the signal, one 
should be able to solve the following minimization problem: 


a* = argmin |a|i, 
subject to y = •F'Fa. 


(16) 


It should be noted that zero-norm can also be used for the purpose of forcing the sparsity. 
In both cases of zero-norm and one-norm, efficiently solving this minimization problem is 
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critical, for example, for hardware components with limited computation power. However, 
in this formulation (zero or) one-norm function is not differentiable, and thus gradient-based 
methods can not be applied. Using the general definition of p-norm, 



one can see that we can benefit from differentiability by taking the value of p to be something 
close to zero and not exactly zero. In this way based on the above definition we will have 
a differentiable version of the zero-norm and so we can use gradient descent methods for 
solving the corresponding least squares problem. However, in this case the problem of 
convexity arises that for p < 1 the norm is not convex and therefore the problem cannot be 
solved in a unique fashion and there will be many convergence issues. Within this context, 
we propose to use a differentiable and “smooth” version of the one-norm and in this way we 
can benefit both the convexity and the differentiability. The authors in m use a similar 
approach for MRI imaging applications, while here we propose to use this algorithm in the 
context of rate reduction of high-speed ADC devices. 

5 Conclusion 

In this paper, we reviewed the concepts of compressive sensing and its application in re¬ 
ducing the sampling rate of high-speed ADC devices. Continuous-time formulation of CS 
is studied within the serial and parallel realizations, which, at their core, consist of three 
main components: (i) pseudo random sequences, (ii) low pass filter, and (iii) low-rate ADC. 
The idea of reducing the sampling frequency has various applications such as sampling rate 
reduction for 60 GHz UWB communication and power saving in wireless sensor networks by 
decreasing the transmission rate. In this paper, we proposed a tweak to the norm optimiza¬ 
tion in the compressive sensing structure in that one-norm minimization is replaced with a 
p-nornr minimization for 1 < p and close enough to 1. In this case, we can benefit from both 
convexity and differentiability of the function, and thus the gradient-based methods can be 
applied. 
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